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A COMPARISON OF SCHOOL MEAN ACHIEVEMENT SCORES WITH TWO ESTIMATES 
OF THE SAME SCORES OBTAINED BY THE ITEM-SAMPLING TECHNIQUE 

Leonard S. Cahen Thomas A. Romberg 

Educational Testing Service University of Wisconsin 

and Walter Zwirner 
University of Calgary 

Abstract 

The study examined the accuracy of estimating test means for groups of 
twelfth-grade students by the item-sampling technique. The subjects used in 
the study were from 35 twelfth-grade schools participating in the National 
Longitudinal Study of Mathematical Abilities. Half of the students in each 
school were assigned to a treatment condition where they took a complete 
2^-item mathematics test on the first day of testing and took item-sampled 
versions of the same test on the second day of testing. A second random 
group of students within each of the schools took the item-sampled version 
of the mathematics test on day 2 but did not take the complete version of 
the mathematics test on day 1. There was no evidence to indicate that the 
taking of the complete 2^-item mathematics test influenced the performance 
on the item-sampled version on the second day of testing. Reasonably close 
estimates of mean performance were obtained from the item-sampling situation 
as compared to the means estimated from the conventional type of testing. 

The differences between the means estimated from conventional type testing 
and from item-sampling testing were found to diminish as a function of the 
number of students tested in the school (square root transformation). 
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A COMPARISON OF SCHOOL MEAN ACHIEVEMENT SCORES WITH TWO ESTIMATES 



OF THE SAME SCORES OBTAINED BY THE ITEM-SAMPLING TECHNIQUE 1 

Leonard S. Cahen Thomas A. Romberg 

Educational Testing Service University of Wisconsin 

and Walter Zwirner 
University of Calgiry 




This study examines how accurately test means for groups of students 
can be estimated by the item-sampling technique. The statistical model for 
estimating means from item-sampled matrices has been outlined by Lord (1962) 
and by Lord and Novick (1968). Item sampling or matrix sampling refers to . 
a general sampling procedure symbolized by a matrix with rows representing 
units (schools in this study) and columns defining measures. The measures 
are computed by Lord’s (1962) procedures which involve the splitting of a 
set of m items into k random subsets of items. The k subsets are then 
assigned randomly to pupils in the £ sampling units. The utility of this 
procedure is in its potential efficiency. Since each student in the 
sampling unit takes only a proportion of the items in the population of 
items, considerable administrative test time is saved. Cronbach (1963) has 
argued for the use of item-sampling in evaluation studies as an efficient 
way to estimate group means. 

Item-sampling studies have been reported by Cahen, Romberg; and Zwirner 
(1970 )> Cook and Stufflebeam (1967), Jacobs and Wildemann (1969); Knapp (1968), 
Lord (1962), Osburn (1967), Owens and Stufflebeam (1969), Plumlee ( 19 610, 
Shoemaker (1970), and Sirotnik (1970). With the exception of the studies 
by Cahen ; Romberg; and Zwirner, Jacobs and Wildemann; Owens and Stufflebeam, 
and Sirotnik, these studies have used existing banks of data, i.e., samples 
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were dra vn post facto from existing test data banks in which each student 
had taken every item in a complete test version. 

The present study is based on test data obtained under a priori item- 
sampling administration conditions. The test used in the study was the 
Project Talent Mathematics Test ., Part 2 ( PTMT-2 ) (Flanagan, Dailey, Shaycoft, 
Gorham, Orr , & Goldberg, 1962 ), a 24-item test containing fairly difficult 
mathematics items . The test was administered in the spring to twelfth-grade 
nonmathematics students participating in the National Longitudinal Study of 
Mathematical Abilities (NLSMA) (Cahen, 1965 ). The total NLSMA twelfth-grade 
testing population was divided into mathematics and nonmathematics classifi- 
cations (Populations 1 and 2) (Romberg & Wilson, 1969). Population 2 NLSMA 
students, the ones used in this study, were defined as those students not 
completing a full year of mathematics beyond algebra and geometry. Population 
1 students had taken a mathematics course beyond algebra and geometry and were 
considered superior mathematics students compared to NLSMA Population 2 students. 

For the item-sampling study, a random half of the Population 2 students 
in each sampling unit (the school) first took all of the items in the FTMT-2 . 

The following day the same students took an item-sampled version of the same 
24-item test. This allowed a comparison between the school means obtained on 
the complete version of the test on day one (Measure A) with the estimate of 
the mean obtained by item sampling for the same students on day two (Measure B). 
One additional mean (Measure C) was obtained by the item-sampling technique 
and was computed for a group of Population 2 subjects in each school who had not 
taken the complete PTMT-2 on the previous day. Figure 1 illustrates the 
testing schema. 

Insert Figure 1 about here 
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A more sophisticated approach would have used a design controlling for 
order of taking the complete 24-item test and the item-sampling version. 

However ^ the more elaborate design was not feasible within the testing 
program of NLSMA. 

The complete 24-item test was administered as a separately timed 24- 
minute section in the NLSMA Spring Battery. Students thus had an average of 
one minute working time per item. For the item-sampled form, the PTMT- 2 
items were embedded in 15 item-sampled booklets or forms. The population of 
sampled items totaled 120 items from NLSMA Test Forms 122 A ; B ; and C ; a group 
of mathematics achievement items that had been administered to the same students 
two and a half years earlier when the students were tenth-grade NLSMA partici- 
pants. Students were also allowed an average of one minute working time per 
item on the test items from NLSMA Test Forms 122 A ; B, and C. 

Table 1 shows the item placement in the 15 item-sampled booklets. 

Insert Table 1 about here 

The PTMT-2 items were randomly assigned without replacement to the 15 
booklets or forms. Each booklet received either one or two of the total 24 
PTMT-2 items and either six or seven NLSMA items ; making a total of eight 
mathematics items per item-sampling booklet. The students were allowed a 
total of eight minutes to complete the eight item-sampling items. In this 
study., therefore; the students were allowed the same amount of working time 
on the item-sampling administrations as they were allowed on the administration 
of the complete PTMT-2 . This hopefully overcame one of the deficiencies in 
the study reported by Cahen; Romberg; and Zwirner (l970) where students 
potentially had more time per item on the item-sampled testing condition 
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than on the conventional testing condition. Within each booklet the eight 
items were then randomly assigned to the eight item positions. Finally; the 
PTMT-2 items were rearranged to preserve the order in which they appeared in 
the regular 24-item test. The NLSMA items from Forms 122 A ; B ; and C were 
also rearranged so that they appeared in the same serial order as they would 
appear in the complete NLSMA 122 A; 33; and C tests. 

After printing; the booklets were collated by sets or blocks of order 
permutations of 15* One copy of each of the 15 booklets was placed in one 
permuted order ; a second set of 15 booklets was placed in a different permuted 
order of 15; etc. The teachers were told to pass out the booklets so that the 
first student received the top booklet; the second student received the second 
booklet; etc. The distribution of booklets to pupils therefore approximated 
a random assignment. 

In the spring testing session there were 149 schools with twelfth-grade 
students participating in NLSMA. However; in most of these schools; very few 
students participating in the testing program were identified as the non- 
mathematics students (Population 2 students). In order to estimate a school 
mean for these students; it was decided that data must be available for a 
minimum of five students on both the complete PTMT-2 and on the item-sampled 
version of the PTMT-2 . This decision is admittedly arbitrary. A more 
restrictive criterion would have required that each PTMT-2 item be attempted 
by at least one student in each school. However; using the minimum require- 
ment of five students; school means (Measures A; 33; and C) were calculated 
for 55 schools. 



Insert Table 2 about here 
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Within each school, the number of students for Measures A and B are the 
same as these students took the complete test on day one and the item-sampling 
version on day two. 

Table 3 shows the means , standard deviations, and intercorrelations of 
the school means on Measures A, B, and C. The difference between the AB 

Insert Table 3 about here 

correlation and the AC correlation was tested by the procedure developed by 
Olkin (1967 ; pp. 111-113) to test for differences between correlated co- 
efficients of correlation. A 95 per cent confidence band was established 
around the difference between the AB and AC coefficients. The value of zero 
barely fell in the confidence interval for the difference between the corre- 
lation coefficients for AB and AC (-.012 = r fl - r = .134). It was concluded 

Aij AO 

that the correlation coefficients of AB and AC were not necessarily signifi- 

/ 

cantly different. It should be pointed out that the correlation coefficient 
AB was computed from measures obtained on the same students. This is not the 
case for the correlation between Measures AC. Measures A and B were obtained 
for one set of students within a school while Measure C was obtained from a 
random but different subset of students within the same school. The corre- 
lation AB might be interpreted as a test-retest coefficient while the AC 
coefficient represents the association between measures obtained on two 
random subset samples from a sampling unit. The additional information 
about reliability was obtained by computing two intraclass coefficients of 
correlation from the data displayed in Table 2. Using the 35 schools 
representing rows and the three measures (A, B, and C) representing columns, 
an intraclass correlation of .835 was obtained. When the two measures 
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estimated by item sampling (B and C). form the columns of the matrix; a 
coefficient of ,679 was obtained. 

The data matrix displayed in Table 2 was also submitted to a multi - 

2 

variate analysis of variance. The 55 rows representing schools in Table 2 
were stratified into three levels defined by the ranges of number of 
students tested in the school. The dependent measures for the analysis 
were A; B ; and C. Table 4 provides data about the ranges of the number of 
students tested in each school by each stratum; number of schools in these 
defined analysis units ; and the means and standard deviations for Measures 
A; B; and C by strata* 



Insert Tables 4 and 5 about here 
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Table 5 shows the results of the multivariate analysis of variance 
from the schema displayed in Table 4. The dimensions of measures and the 
interaction of measures by strata yielded F values of less than one. The 
stratification dimension yielded an F value of 2.84 (p < .063 9 - On the 
average the schools with the smaller number of students tested yielded 
higher mean scores on Measures A; B; and C than the stratum two and stratum 
three schools as defined in Table 4. On the average; the mean performance • 
on Measures A; B; and C was lower for the stratum three schools than for the 
stratum Wo schools. 

It appears that the item-sampling procedure provides reasonably precise 
estimates of school achievement. This statement is supported by the corre- 
lational data reported in Table 5 and by the small variance attributed to 
the dimension of measures as shown in Table 4. Table 6 provides additional 
information about the magnitude of the difference scores between Measures AB; 
AC ; and BC . 
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Insert Table 6 about here 

Another point must be considered in the interpretation of the magnitude 
of the difference scores shown in Table 6. Cahen ; Romberg; and Zwirner (1970); 
in an earlier paper on the item-sampling procedures; pointed out that errors 
of measurement are present in both measures obtained from conventional sam- 
pling as well as'from scores obtained from item- samp ling* These errors of 
measurement will attenuate the measures of association between Measures A ; 

B; and C. In the previous research reported by Cahen ; Romberg; and Zwirner 
(1970); it was shown that the magnitude of error between the means estimated 
by conventional sampling and from item sampling decreased as the number' of 
students tested in the school increased, They reported that the error between 
these two measures decreased as a function of the square root of the number 
of students tested. 

In order to study the relationship between magnitude of error as a 
function of the number of students tested in the school from the data 
available here ; a fourth measure (Measure D) was created. Measure D is a 
weighted mean of Measures B and C. The estimate of this combined mean was 
computed by a formula provided by McNemar (1962; p. 18) . Data on Measure D ; 
the number of students tested in each school used in estimating Measure D ; 
and the deviation of Measure D from Measure A; are shown in Table 7- The 
n for Measure D is the sum of the n T s for Measures B and C. 

Insert Table 7 about here 
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The signs (plus or minus) of the deviation of Measure D from Measure A 
showed an approximately equal number of pluses and minuses. Also, there was 
no statistical relationship between the number of students tested in the 
school and the sign of the deviation of Measure D from Measure A. It was 
therefore decided to use the absolute deviation of Measure D from Measure A 
in studying the relationship of this measure to the number of students tested 
in the school. 

Table 8 shows a bivariate plot of the regression of the absolute devia- 
tion between Measures D and A on the number of students tested in the school. 
A square root transformation was used on the latter variable. The • data 

Insert Table 8 about here 

displayed in Table 8 show a decrease in the magnitude of the absolute 
deviation of Measure D as the number of students tested in the school 
increases . 

The correlation between Measure D and the square root of the number of 
students tested was .398 which is significant at the .05 level. 

In addition to fitting the data by a simple linear regression models a 
second regression analysis was performed by adding a second degree polynomial 
term. The addition of the second degree polynomial term into the regression 
equation did not significantly provide a better fit of the regression of the 
absolute deviation on the number of students tested. 

We believe this study provides additional empirical information on the 
practical utility of the. -item- sampling procedure. As in the previous study 
reported by Cahen ; Romberg; and Zwirner (l970)^ it has been shown that the 
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measurement error attributable to item sampling decreases as the number of 
students in the schools increase. 

The researcher-evaluator who intends to use the item-sampling procedure 
is again encouraged to consider the magnitude of error he can afford in his 
estimation of estimates of means for sampling units (classes ^ schools; etc.). 
With this type of decision making strategy it should be possible for the 
researcher-evaluator to determine the minimum number of students he needs 
in his sampling units in order to preserve a reasonable magnitude of 
measurement error t 
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Table 1 

Item Source Key for NLSMA Year III Spring Battery Booklets 
Booklets 12^ through 12 ^ q (item-sampled) 



!2-3A 12-3B 12-3C 



Item 


Source 


Item 


Item 


Source 


Item 


Item 


Source 


Item 


7 


12 2A 


2 


7 


122A 


23 


7 


122A 


4 


8 


12 2A 


17 


8 


122A 


30 


8 


PTMT-2 


bo 


9 


122A 


27 


9 


PIMT-2 


21 


9 


122A 


22 


10 


122A 


37 


10 


ptmt-2 


36 


10 


122A 


26 


11 


PTMT-2 


31 


11 


122A 


bb 


11 


122A 


29 


12 


122B 


23 


12 


122B 


1 


12 


122B 


4 


13 


122B 


ho 


13 


122B 


5 


13 


122b 


24 


i4 


PTMT-2 


37 


Ik 


122B 


•19 


14 


122C 


24 


12 -3D 






12-3E 






12-3F 






Item 


Source 


Item 


Item 


Source 


Item 


Item 


Source 


Item 


7 


122A 


1 


7 


122A 


10 


7 


122A 


19 


8 


122A 


21 


8 


PTMT-2 


28 


8 


122A 


25 


9 


122B 


17 


9 


122A 


2 b 


9 


122A 


36 


10 


122B 


21 


10 


122A 


43 


10 


PTMT-2 


19 


11 


122B 


26 


11 


122B 


6 


11 


122A 


42 


12 


PTMT-2 


20 


12 


PTMT-2 


38 


12 


122B 


39 


13 


122B 


4l 


13 


122B 


15 


13 


122B 


43 


14 


122C 


37 


i4 


122B 


44 


14 


PTMT-2 


39 


SOURCE : 


NLSMA. 
















SOURCE; 


122 A, 


122B, and 


122C (NLSMA. Forms 


122A, B, 


and C) 
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Table 1 (cont'd) 



12-5G 






12-5H 






12-51 






Item 


Source 


Item 


Item 


Source 


Item 


Item 


Source 


Item 


7 


122A 


8 


7 


122k 


5 


7 


122A 


6 


8 


122A 


i4 


8 


122k 


12 


8 


122A 


55 


9 


122A 


15 


9 


122B 


5 


9 


122A 


4o 


10 


122A 


20 


10 


PTMT-2 


24 


10 


122B 


n 


11 


122B 


7 


11 


PTMT-2 


52 


11 


PTMT-2 


18 


12 


122B 


27 


12 


122B 


. 9 


12 


122B 


28 


15 


FEMT-2 


26 


15 


122B 


54 


15 


122B 


55 


Ik 


122C 


51 . 


i4 


122B 


56 


14 


122C 


4 


12 -3 J 






12-3K 






12-3L 






Item 


Source 


Item 


Item 


Source 


Item 


Item 


Source 


Item 


7 


122A 


5 


7 


122A 


9 


7 


PTMT-2 


25 


8 


PTMT-2 


50 


8 


122A 


18 


8 


122A 


7 


9 


PTMT-2 


54 


9 


PTMT-2 


29 


9 


PTMT-2 


55 


10 


122A 


11 


10 


122k 


45 


10 


122k 


16 


11 


122A 


55 


11 


122B 


18 


11 


122k 


28 


12 


122k 


59 


12 


122B 


20 


12 


122k 


52 


13 


122 B 


8 


15 


122B 


55 


15 


122k 


54 


14 


122 B 


57 


- l4 


122C 


27 


14 


122k 


4l 
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Table 1 (cont'd) 



12-5M 






12-3N 


Item 


Source 


Item 


Item 


7 


122B 


2 


7 


8 


122B 


13 


8 


9 


PTMT-2 


17 


9 


10 


122B 


16 


10 


11 


122B 


30 


11 


12 


122B 


31 


12 


13 


PTMT-2 


25 


13 


14 


122B 


42 


14 



1 

j, 

IerJ!c 



12-30 



Source 


Item 


Item 


Source 


Item 


PTMT-2 


27 


7 


122A 


13 


122A 


38 


8 


PTMT-2 


22 


PTMT-2 


35 


9 


122A 


31 


122B 


10 


10 


122B 


25 


122B 


12 


11 


122B 


29 


122B 


14 


12 


122B 


32 


122B 


22 


13 


122B 


38 


122B 


45 


14 


122C 


10 
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Table 2 
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Measures A, B, and. C for 35 Schools with Group 2 Students 
in the NLSMA 12th Grade Population 



School 


N 


Measure A 


N 


Measure B 


N 


Measure C 


1 


55 


10-65 


55 


11.12 


65 


10.06 


2 


75 


9.85 


75 


9.65 


63 


n.07 


3 


99 


8.74 


99 


9.72 


104 


8.96 


4 


55 


7.62 


55 


8.46 


51 


9.16 


5 


k 3 


7-79 


43 


6. 54 


43 


7.77 


6 


36 


13-22 


36 


11.02 


55 


15.17 


7 


25 


12.64 


25 


12.00 


22 


8.95 


8 


55 


10.90 


55 


11.34 


50 


n.50 


9 


58 


10.14 


58 


9.82 


56 


8.74 


10 


29 


7.48 


29 


9-58 


51 


8.00 


11 


19 


8.26 


19 


11.20 


25 


10.26 


12 


55 


14.15 


55 


13.54 


27 


15.25 


13 


19 


14.21 


19 


15-63 


16 


14.56 


14 


25 


13-39 


25 


12 . 62. 


18 


13.00 


15 


15 


12.27 


15 


12.22 


22 


14.17 


16 


18 


13.56 


18 


13.60 


25 


16.62 


17 


15 


10.60 


15 


13.80 


16 


10.91 


18 


15 


11.60 


15 


12.60 


55 


11.22 


19 


15 


10.07 


15 


11.11 


15 


10.50 


20 


27 


11.44 


27 


13.88 


24 


12.00 


21 


23 


9-59 


25 


9.00 


21 


9.70 


22 


28 


9-07 


28 


6.43 


26 


11.54 


23 


24 


11.25 


24 


8.75 


20 


12.82 


24 


17 


10.23 


17 


12.00 


20 


6.00 


25 


18 


6.22 


18 


8.18 


25 


5.54 


26 


19 


11.42 


19 


11.09 


22 


13.70 


27 


19 


10.47 


19 


13-00 


17 


12.00 


28 


35 


11.74 


55 


12.46 


55 


14.42 


29 


17 


11.76 


17 


IO.25 


7 


5.50 


30 


15 


11.13 


15 


12.75 


12 


12.50 


31 


19 


7.05 


19 


5.60 


15 


5-34 


32 


16 


12.75 


16 


11.34 


11 


12.75 


33 


7 


14.00 


7 


16.00 


15 


16.00 


3 k 


5 


9.60 


5 


16.00 


21 


7.69 


35 


Ik 


i4.i4 


14 


12.00 


17 


13.50 



19 
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Table 3 

Means , Standard Deviations , and Intercorrelations 
for' Measures A, B, and C 

(N = 35) 





A 


B 


c 


X 


O 


A 


1.000 


.688 


.7^9 


10.82 


2.18 


B 




1.000 


1 — 1 
OJ 
L f\ 


11.26 


2.5^ 


C 






1.000 


10.99 


3.01 



ERJC 



20 
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Table k 



Means and Standard Deviations for Measures A, B, and C 
for 35 Schools Stratified by the Number of 
Students Tested in the Schools 



Strata 


Ranges of 
Number of 
Students Tested 
in Schools 
in Strata 


N of 
Schools 


Measure 

A 


Measure 

B 


Measure 

C 


1 


2-18 


13 


X 11.38 
a 2.15 


X 12 . 1+5 
a 2.1b 


X 10.99 

a 3.81 


2 


19 - 50 


16 


X 10.81 
o 2.k0 


x 10.76 

a 2.91 


X 11.39 
a 2.80 


3 


51 - 99 


6 


x 9.65 

0 . 1.25 


X 10.02 
a 1.06 


X 9.92 

a 1.16 



O 

ERIC 



m 



21 
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Table 5 

Multivariate Analysis of Variance of Measures A, B, and C 
for 35 Schools Stratified by the Number of 
Students Tested in the Schools 



Source 


SS 


DF 


MS 


F 


P 


Measures 


3 . Hi 


2 


1.70 


.26 


.774 


Strata 


31.67 


2 


18.84 


2.84 


.063 


Measures X Strata 


15.80 


4 


3.95 


.60 


.666 


Error 


636.23 


96 


6.63 








22 
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Table 6 

Number of Students Tested and Difference Scores between 
Measures A , B> and C for 35 Schools 



S chool 


NA 


NB 


1 


55 


55 


2 


75 


75 


3 


99 


99 




53 


53 


5 


43 


43 


6 


36 


36 


7 


25 


25 


8 


53 


53 


9 


58 


58 


10 


29 


29 


li 


19 


19 


12 


33 


33 


13 


19 


19 


14 


23 


23 


15 


15 


15 


16 


18 


18 


17 


15 


15 


l8 


15 


15 


19 


- 15 


- 15 


20 


27 


27 


21 


23 


23 


22 


28 


28 


23 


24 


24 


24 


17 


17 


25 


18 


18 


26 


19 


19 


27 


19 


19 


28 


35 


35 


29 


17 


17 


30 


15 


15 


31 


19 


19 


32 


16 


16 


33 


7 


7 


3 k 


5 


5 


35 


14 


l4 



X 



O 

ERIC 



NC 


A-B 


A-C 


B-C 


65 


-.47 


• 59 


1.06 


63 


.20 


-1.22 


-1.42 


104 


-98 


-.22 


.76 


51 


-.84 


-1-54 


-.70 


43 


1.25 


.02 


-1.23 


35 


2.20 


-1.95 


-4.15 


22 


.64 


3.71 


3-C7 


50 


-.44 


-.60 


-.16 


56 


• 32 


1.40 


1.08 


31 


-1.90 


-•52 


1.38 


25 


-2.94 


-2.00 


,94 


27 


.61 


.90 


.29 


16 


-1.42 


-•15 


1.27 


18 


•77 


•39 


-.38 


22 


.05 


-1.90 


-1-95 


23 


-.04 


-3.06 


-3.02 


16 


-3.20 


-•31 


2.89 


33 


- 1.00 


• 38 


1.38 


. 15 


-1.04 


-.43 


.61 


24 


-2.44 


-.56 


1.88 


21 


• 39 


-•31 


-.70 


26 


2.64 


-2.47 


-5-11 


20 


2.50 


-1-57 


-4.07 


20 


-1.77 


4.23 


6.00 


23 


-1.96 


.68 


2.64 


22 


.33 


-2.28 


-2.61 


17 


-2.53 


-1.53 


1.00 


35 


-.72 


-2.68 


-1.96 


7 


1.51 


6.26 


4.75 


12 


-1.62 


-1.37 


.25 


13 


1.45 


I.71 


.26 


11 


i.4i 


0 


-1.4l 


15 


-2.00 


-2.00 


0 


21 


-6.40 


1.91 


8.31 


17 


2.14 


.64 


-1.50 




-0.44 


-0.17 


0.27 




1.89 


2.00 


2-75 



22 
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Table 7 

Nj Measure D (Weighted Mean of Means B and C), and the Discrepancy 
between Measure D and Measure A 





N of Measure D 


Measure D 


Deviation oj 




(Combined n‘s of 


(Weighted Mean of 


Measure D 


School 


Weighted Mean B & C) 


B 8c C Means ) 


from Measure 


1 


120 


10.54 


0 11 


2 


138 


10.30 


-0.45 


3 


203 


9.53 


-.59 


4 


104 


8.80 


-1.18 


5 


86 


7.16 


.63 


6 


71 


13.06 


.16 


7 


47 


10.56 


2.08 


8 


103 


11.42 


-•52 


9 


114 


9.29 


.85 


10 


60 


8.67 


-1.19 


11 


44 


10.66 


-2.40 


12 


60 


13-41 


.74 


13 


35 


15.05 


-.84 


l4 


4l 


12.79 


.60 


15 


57 


13.38 


-1.11 


16 


4l 


15.29 


-1-75 

-| ,-7 -| 


- 17 * " 


31 


12 . 31 


-1.71 


18 


48 


11.65 


-•05 


19 


30 


10.80 


-•75 


20 


51 


13.00 


-1.56 


21 


44 


9-53 


.06 


22 


54 


8.89 


.18 


23 


44 


10.60 


• 65 


24 


57 


8.76 


1.47 


25 


4l 


6.70 


-.48 


26 


4l 


12.49 


-1.07 


27 


56 


12.53 


-2.06 


28 


70 


13.44 


-I.70 


29 


24 


8.86 


2.90 


30 


27 


12; 64 


-1.51 


31 


52 


5.49 


1.56 


32 


27 


11.91 


.84 


33 


22 


16.00 


-2.00 


34 


26 


9-29 


.31 


55 


51 


12.82 


1.32 



erIc 



24 



-23 



Table 8 

Bivariate Relationship between Absolute Deviation of Measure D 
and Measure A and the Number of Students Tested in 
the School (Square Root Transformation) 



Absolute 
Deviation 
of Measures 
D and A 





1 






















j 
























1 






1 




















1 




2 


















1 


i ; 






















i 




3 


1 


1 


1 














! 

1 




| 1 


1 






i 














! 


2 


1 




j 1 


1 


! 










i 








1 1 

■ 
















2 


1 




1 1 1 

i 








l 






1 


1 






1 


1 














2 


1 

1 


1 


| 1 











2-75 - 2. 
2.50 - 2. 

2.25 - 2, 
2.00 - 2 . 
1-75 - I- 
1.50 - 1 - 

1.25 - 1- 
1.00 - 1 . 

•75 - • 

.50 - . 
.25 - . 
.00 - 



99 ■ 
74 
b9 
2b 

99 

7b 

b9 

2b 

99 

7b 

b9 

2b 



3-99 4.99 5-99 6.99 7-99 8-99 9-99 10-99 32.99 12-99 13-99 14.99 

Number of Students Tested 
(Square Root Transf ormation ) 



S3 

ERIC 
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Figure 1 
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